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BACKGROUND OF THE INVENTION 

1 . Field of the Invention : 

The present invention relates to cardiac modeling, and 
more particularly to a method for creating a 3-D statistical 
shape model of the left ventricle from sets of sparse 2-D 
contour inputs. 

2 . Discussion of Prior Art : 

Statistical Shape models are powerful tools for 
morphological analysis and object recovery. They may be 
employed in classification by standing as a point of 
comparison, which embodies the common characteristics of a 
group, DeQuardo JR. et . al . , relationships of neuroanatomic 
landmarks in schizophrenia. Psychiatry Research. 67(1) .-81-95, 
1996 May 31. Statistical Shape models may also be used as the 
basis for prediction. Given a set of views of an object, 
Statistical Shape models allow the morphology of unobserved 
regions to be inferred, Fleute M, Lavallee S. Nonrigid 3-D/2-D 
registration of images using statistical models. MICCAI' 99 
Springer-Verlag. 1999, pp. 138-47. Berlin, Germany. Indeed, 
statistical shape models have been used to determine features 
other than shape, such as volume, based on extrapolation from 
limited observations, Ruff CF, Bhalerao A, Hughes SW, D'Arcy 



TJ, et. al . , The estimation of fetal organ volume using 
statistical shape analysis* Computer Assisted Radiology. 1996, 
pp. 280-5. Anatomical atlases, which provide physicians and 
surgeons with roadmaps to the body, are another incarnation of 
5 these models. In object segmentation, statistical models may 
serve as a prior in a probabilistic formulation of the task , 
Gonzalez B et. al., Combined statistical and geometrical 3D 
segmentation and measurement of brain structures. Workshop on 
Biomedical Image Analysis 1998, pp. 14-23, or form the basis 
10 for constraining possible resultant deformations. 

There has been a great deal of work in recent years on 

0 developing statistical shape models for morphological 

Si 

U1 analysis, Bookstein FL. Shape and the information in medical 

§1 

images: a decade of the morphometric synthesis. [Journal 

.1.5 Paper] CVIU, vol.66, no. 2, May 1997, pp. 97-118, Cootes TF, et . 

fir al., Flexible 3D models from uncalibrated cameras. Image & 

ru . . 

m Vision Computing, vol.14, no. 8, Aug. 1996, pp. 581-7. 

Some work focuses on the problem of generating a dense 

set of landmarks semi-automatically . Fleute and Lavallee 
2 0 rigidly map several training examples of a femur to a densely 

sampled template instance, then use the inversions of these 

mappings to obtain corresponding points on each of the 

examples . 

Lorenz and Krahnstover automatically locate candidates 
25 for landmarks via a metric for points of high curvature, 
Lorenz C, Krahnstover N. Generation of point -based 3D 

2 



statistical shape models for anatomical objects. CVIU, vol.77, 
no. 2, Feb. 2000, pp. 175-91. This method is not applicable to 
the heart because the LV of the hearts lacks such features. 

Brett and Taylor merge decimated polygonal 
representations of objects in a tree-like fashion, Brett AD, 
Taylor CJ. A method of automated landmark generation for 
automated 3D PDM construction. Image & Vision Computing, 
vol.18, no. 9, June 2000, pp. 739-48 . Associations are made 
between objects via a symmetric Iterative Closest Point (ICP) 
algorithm. The ICP algorithm calls for re-mapping the 
polygonal structures . 

Kelemen, Szekely and Gerig express their statistical 
shape models in terms of spherical harmonics and include the 
pose of the organ under study as part of the model, Kelemen A, 
et . al., Three-dimensional model-based segmentation of brain 
MRI. Workshop on Biomedical Image Analysis IEEE Comput . Soc. 
1998, pp. 4-13. 

However, the prior art does not take into account the 
lack of identifiable landmarks and sparse inputs. Therefore, a 
need exists for a system and method for creating a 3-D 
statistical shape model of the left ventricle from sets of 
sparse 2-D contour inputs. 

SUMMARY OF THE INVENTION 

According to an embodiment of the present invention, a 
method is provided for the generation of a 3D statistical 



shape model for a left ventricle of a heart. The method 
includes generating an average left ventricle by aligning the 
datasets, selecting landmarks, and setting weights expressing 
confidence for each landmark, and determining a statistical 
model from a set of aligned shape model by principle component 
analysis . 

According to an embodiment of the present invention, a 
method is provided for the generation of a 3D statistical 
shape model for a left ventricle of a heart. The method 
includes creating a template model, aligning a plurality of 
left ventricle contour datasets, and assigning a plurality of 
landmarks to the datasets. The method further includes 
averaging the landmarks, and determining a statistical model 
from a plurality of aligned shape models. 

Creating the template model further comprises determining 
a pose of the left ventricle according to a short axis and a 
lateral-to-septal-wall direction, and positioning a plurality 
of models in the dataset according to the pose. The method 
includes fitting each model to a contour data, wherein the 
pose and a parametric component can change, and averaging the 
parametric component for each model to create the template 
model . 

Aligning further comprises the step of aligning the 
dataset to the template model. Aligning the dataset to the 
template model further includes associating a plurality of 
individual contour points in each dataset with a corresponding 



model, isotropically scaling each model to fit the template 
model, and scaling the dataset to fit the template model. 

Assigning the plurality of landmarks to the datasets 
further comprises the step of associating model surfaces using 
the template model. 

Assigning the plurality of landmarks includes fitting, 
completely, a model to each dataset, and determining a point 
on each of a plurality of surfaces of the model which is 
closest to each of a plurality of nodes of the template model. 
The nodes are points wherein at least three polygons 
comprising the template model meet. 

Averaging the landmarks includes determining a confidence 
of each landmark, scoring each confidence, and averaging the 
landmarks according to a membership function of a scored value 
of the corresponding confidences. 

Statistical model is determined according to a principle 
component analysis . 

According to an embodiment of the present invention, a 
program storage device is provided readable by machine, 
tangibly embodying a program of instructions executable by the 
machine to perform method steps for the generation of a 3D 
statistical shape model for a left ventricle of a heart. The 
method includes creating a template model, aligning a 
plurality of left ventricle contour datasets, and assigning a 
plurality of landmarks to the datasets. The method further 



includes averaging the landmarks, and determining a 
statistical model from a plurality of aligned shape models* 

BRIEEF DISCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention will be 
described below in more detail, with reference to the 
accompanying drawings : 

Fig. 1 shows an LV dataset made up of five short axis 
image planes and two long axis image planes according to an 
embodiment of the present invention; 

Fig. 2 shows a non-statistical model formation according 
to an embodiment of the present invention; 

Fig. 3 is a graph showing the weight membership function 
according to an embodiment of the present invention; 

Figs. 4a-b show average models of an epicardial surface; 

Figs. 4c-d show average models of an endocardial surface 

Fig. 5a shows an epicardial surface in a first mode of 
variation by three standard deviations according to an 
embodiment of the present invention; 

Fig. 5b shows an endocardial surface in a first mode of 
variation by three standard deviations according to an 
embodiment of the present invention; 

Fig. 5c shows an epicardial surface in a second mode of 
variation by three standard deviations according to an 
embodiment of the present invention; and 



Fig. 5d shows an endocardial surface in a second mode of 
variation by three standard deviations according to an 
embodiment of the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

A method is proposed for developing a statistical shape 
model of the left ventricle (LV) of the heart. The present 
invention assumes the existence of a set of segmented LV 
instances culled from both patient and volunteer Magnetic 
Resonance (MR) datasets. The LVs were segmented using Siemens 7 
ARGUS tool that draws two-dimensional (2-D) contours on 
individual image slices. Referring to Fig. 1, each MR dataset 
includes about, six to seven short axis slices, e.g., 101, and 
at least one long-axis slice, e.g., 102. The datasets provide 
sparse but adequate coverage of the LV, for example as shown 
in Fig. 1. Note that the positions of the image slices with 
respect to the LV can vary from dataset to dataset. Therefore, 
contours may delineate different sections of the LV and cannot 
be used directly as landmarks. 

Given these inputs, in order to develop a statistical 
model of the LV, the method employs a user-defined landmark- 
based method. User-defined landmark-based methods can be 
challenging as well as time consuming because there may be 
very few distinct features in the underlying LV on which to 
specify such points. Further, since, the landmarks may not be 
directly delineated by the contours, the concept. 
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To address these concerns, according to an embodiment of 
the present invention, a dense set of landmarks is generated 
in a semi-automatic way. As mentioned, the LV has very few 
distinct, easily labeled points; however, there are several 
overall shape similarities expressed as regions of curvature, 
A model -based approach is implemented to interpolate between 
sparse contours and align the models using the overall shape. 
A dense set of new associations (landmarks) is generated 
between the model surfaces based on a distance metric. The 
landmarks are averaged using a weighted sum based on a 
landmark's proximity to its contours. A statistical shape 
model is generated by principle component analysis using these 
landmarks . 

It is to be understood that the present invention may be 
implemented in various forms of hardware, software, firmware, 
special purpose processors, or a combination thereof. In one 
embodiment, the present invention may be implemented in 
software as an application program tangibly embodied on a 
program storage device. The application program may be 
uploaded to, and executed by, a machine comprising any 
suitable architecture. Preferably, the machine is implemented 
on a computer platform having hardware such as one or more 
central processing units (CPU) , a random access memory (RAM) , 
and input/output (I/O) interface (s) . The computer platform 
also includes an operating system and micro instruction code. 
The various processes and functions described herein may 
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either be part of the micro instruction code or part of the 
application program (or a combination thereof) which is 
executed via the operating system. In addition, various other 
peripheral devices may be connected to the computer platform 
such as an additional data storage device and a printing 
device . 

It is to be further understood that, because some of the 
constituent system components and method steps depicted in the 
accompanying figures may be implemented in software, the 
actual connections between the system components (or the 
process steps) may differ depending upon the manner in which 
the present invention is programmed. Given the teachings of 
the present invention provided herein, one of ordinary skill 
in the related art will be able to contemplate these and 
similar implementations or configurations of the present 
invention. 

According to an embodiment of the present invention, a 
model -based alignment for sparse inputs is provided and the 
weighting of landmarks which appropriately describe the 
reliability of each landmark's situation is determined. 

The LV model formulation has two walls expressing the 
inner, endocardial, and outer, epicardial, surfaces. The LV 
model is described using a parametric component which is 
essentially ellipsoidal and can account for the overall shape 
of the LV and includes parameters such as apex-to-base length, 
epicardial lateral -wall radius and valve plane height, and a 



local spline- like mesh which deforms away from the parametric 
component and represents finer features. The spline-like 
meshes form the outer surfaces of the model. Fig. 2a shows 
both an inner wall 201 and an outer wall 202. In Fig. 2b the 
outer wall 202, a spline-like mesh deformation from a 
parametric component, and an underlying parametric component 
203 are shown. The inner wall has the same configuration. 

This model formulation has the advantage that it has a 
rough description of the object built into it, the parametric 
component. According to an embodiment of the present 
invention, this aspect of the model formulation can be 
exploited when aligning different model instances to create 
the average model. 

When fitting to a dataset, the model is capable of 
deforming in various ways. The model may change its pose. The 
model may adjust the parametric component in order to change 
its general shape. In addion, the spline-like mesh may extend 
to describe any local features of the data. In the process of 
creating an average LV model the method, at different stages, 
makes use of all of these deformation modes. 

The method creates a template model T r aligns the 
datasets making use of this template, fits models M± to each of 
the aligned datasets, makes associations (landmarks) between 
the model surfaces using the template model, and averages 
those landmarks to create a Procrustes mean shape. 



For each of the n datasets, the user specifies the pose 
of the LV by determining the short axis and the lateral-to- 
septal-wall direction. A model, L ±f i=l..M, is positioned in the 
data using this information. The model is fit to the contour 
data D±, i=l...n by allowing it to change its pose and parametric 
component. No local deformations are performed. Since the LV 
is largely rotationally symmetric about the short axis, there 
is little change in the pose of the model L± during the fit. 
Thus, the same parameters in different models will describe 
the same regions, e.g., the endocardial septal wall radius 
parameter will describe the endocardial septal wall radius in 
each of the models. The template model T is created by 
averaging the parameters of the parametric component of the 
models. The center of T is set to be the origin and its axes 
the coordinate axes. 

To align the datasets, in summary, the method associates 
the individual contour points in each dataset D± with the 
corresponding model L±. The method isotropically scales the 
models L± to fit to the single template T. This same scaling is 
applied to the dataset D±. The method explicates: 

The models are polygons expressed as nodes and edges. 
Let Nij={(x.±j, y±j, Zij) } be the nodes on model L± and 

D lk ={ (x ik/ y± k , Zik) } k=l...m be a vector describing the points 
on a contour Di, and. Each contour point's model-based 
coordinate C ik ={ (x ik/ y± k , z ik ) } k=l....m is defined as: 



C a = mk ( (P, - N tj ) (1) 

Thus, Ci k associates a contour datapoint with the model Li with 
the closest node N i:j . We term NiiDij) to be the closest node so 
that Dij = C ik + NiiDij) . 

A transformation H is searched for, which minimizes a sum 
of square Euclidean distance between each L ± and T. This 

transformation composed a scaling s, a rotation 6 = {0 X , 6 y , 

0 Z } and a transformation t = (tx,ty,tz) is applied to the 
fitted model L ± via its nodes N ± j. 



H(N tJ ) = sR (6)N l3 + 



(2) 



where R(9) is the rotation operator. The best fit 
transformation may be found by minimizing the surface distance 
between the L ± and the template T . 



Min || X (HiN^-T) 



(3) 



7 = 1.../ 



After the transformation, the size and pose of Li, have 
been changed to best fit T. This transformation is applied to 
the contours. The new contour coordinates D' are given by: 

D'k = H(N t (D lk )+C lk ) (4) 

Where Ni (D ik ) is the nearest model node coordinate of a contour 
point D ik . At this point all the contour datasets D[ are 



aligned and centered around the template T. 



To each dataset D[ a model M± is fit. This is a complete 
fit including changes to the model's pose, parametric 
component, and local mesh. This results in a set of closely 
fit models to the contour datasets. 

To assign landmarks, recall that the template model T is 
expressed as a polygon made up of nodes and edges and that the 
models M± are centered around T. These nodes of T are used as 
the basis for the landmarks . For each node Tj we find the 
closest point on each of the surfaces of model M±. 

R 9 (x,y,z) = {S l {x,y 9 z)\Min \\ (S t (x, y , z) - \\} for V S y, z) e M l (5) 

Thus, each of the models M± has a set of 1 landmarks, R ijf that 
are linked by being the closest points on each model to the 
nodes of the template T* 

The landmark positions are averaged from all the models 
to create the average shape. Rather than taking a simple 
average, the method employs a weighted average. This is 
because the contour datasets from are not dense. Differing 
landmarks will have differing contour environments. Some 
landmarks will be surrounded by datapoints leading the method 
to have high confidence in their position with respect to the 
underlying LV. Others will fall on a region of the model 
surface, which is relatively devoid of datapoints. To express 
the confidence in the landmarks, the following formula is 
employed. 



c = „ _ 11 . ,„ (6) 



''7 

m =1 ...rj 



J,\\D m -R y || 2 + £ 



where T| is the number of datapoints, D im , for which is the 

closest landmark. This value rewards landmarks with many 
datapoints for which it is the closest landmark and where the 
5 distance to the landmark is small. 

However, directly using such confidence level as a weight 
to derive the average model seems impractical, because its 
value may range from 0 to more than 200, as shown in Fig. 3. 
If the method employs c ±j directly in the weighted sum to 
SPo derive the average model, some landmarks with higher weights 
© may overreact, particularly in the presence of noisy data. To 
avoid such a situation, the confidence level is scored by a 
membership function. Fuzzy membership functions are selected. 
Therefore, the landmarks with high weights can have just 
|!Ss enough of a contribution to the average model. More precisely, 
p if a confidence level is high, it is said to have a high 

?■}'- 

degree membership of contribution to the average model and set 
its membership as one; otherwise, its membership is set below 
one. The corresponding membership function is given by 
20 carefully studying the training data. The curve 301 in Fig. 3 
gives the distribution of the confidence level of landmarks 
from fourteen training data sets. Based on our numerous 
experiments, the membership function is constructed using a 
Gaussian and uniform functions. 



m 
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0.5 + 0.5 * , e H a > if c< th 

^ (7) 

1 if c XJ > th 



where th is a threshold derived from the distribution of the 
confidence level. The curve 302 in Fig. 3. shows the 
membership function defined in Eq. (7) . 

Having all landmarks and their corresponding confidences, 
the average model can be determined by: 

Rj = ^\ (8) 

Where, Rij is the position of a landmark, is the position of 

the landmarks in the average model . 

Once the average LV shape model is obtained, the LV shape 
model variations can be analyzed by applying a principal 
component analysis on the training data. Each computed 
principal component gives a 'mode of variation' , a way in 
which the landmark points tend to move together as the shape 
varies . 

Each models' shape is given by j landmarks. Based on our 
3D training models, we can calculate the 3j*3j covariance 
matrix S using 



This matrix has some particularly useful properties, since it 
demonstrates variation in some directions more than in others. 
These variations' directions and importance may be derived 
from an eigen-decomposition of S by solving the equation (10) 

8 V k = e* V k (10) 
The solutions to Eq.10 provide the eigenvector (k = 1,2, 
,3x1) and their eigenvalues e k of S. Conventionally, we assume 
e ±> e It can be shown that the eigenvectors associated 

with larger eigenvalues correspond to the directions of larger 
variation in the underlying training data. 

Note that any shape in the training set can be 
approximated using the mean shape and a weighted sum of these 
deviations obtained from the first t modes. Where b = (b lf 
b 2 ,b 3 , ... b t ) is the vector of weights, which indicates how much 
variation is exhibited with respect to each the eigenvectors. 

The method according to a preferred embodiment of the 
invention was used to generate a 3D statistical LV model from 
a pool of fourteen subjects as shown in Figs. 4a-d. Fig. 4a 
shows a side view of an epicardial surface, Fig. 4b shows a 
top view of the epicardial surface. Fig. 4c shows a top view 
of an endocardial surface, Fig. 4d shows a side view of the 
endocardial surface. Each dataset is created by a user 
delineating the endocardial and epicardial boarders. 

Table 1 illustrates the relative contribution of the most 
influential components. From this more than 90% of the shape 
variation can be captured by the first ten eigenvectors. 



Index 


(Xi/X 


Cumulative 




total) 


total 


1 


41.3769 
% 


41 .3769% 


2 


10.4376 

o, 
o 


51.8144% 


3 


9.0261% 


60.8406% 


4 


7.5134% 


68.3540% 


5 


6.2111% 


74 .5651% 


6 


4 . 0443% 


78.6094% 


7 


3 . 9312% 


82 .5406% 


8 


3 .4228% 


85.9634% 


9 


3 .0939% 


89.0573% 


10 


2 .7707% 


91.8280% 


11 


2 .4029% 


94 .2309% 


12 


2 . 0720% 


96.3029% 



Table 1. 



Figs. 5a-d shows front and top views of reconstructed 
shapes obtained by varying the first two model parameters 
(bl,b2) . In particular, Fig. 5a shows a first mode of 
variation by three standard deviations for an epicardial 
surface, and Fig. 5b shows a first mode of variation by three 
standard deviations for an endocardial surface. Further, Fig. 
5c shows a second mode of variation by three standard 
deviations for the epicardial surface, and Fig. 5d shows a 
second mode of variation by three standard deviations for the 
endocardial surface. The first eigenvector, which accounts for 
more than 40% of the variation seen in the data, captures the 
size information of LV. The second parameter varies the 
appearance of upper part of LV. All other higher modes show 
asymmetric properties of LV shapes. 

Referring to Fig. 6, the method for the generation of a 
3D statistical shape model for a left ventricle of a heart. 



includes creating a template model 601, aligning a plurality 
of left ventricle contour datasets 602 , and assigning a 
plurality of landmarks to the datasets 603. The method further 
includes averaging the landmarks 604, and determining a 
statistical model from a plurality of aligned shape models 
605. 

A method for the generation of a 3D statistical shape 
model for left ventricle of heart is provided. Given a set of 
sparse LV contour datasets, the method generated the average 
LV by aligning the datasets, selecting landmarks, and setting 
weights expressing confidence for each landmark. Further, the 
method derived a statistical model from a set of aligned shape 
model by principle component analysis. This method has been 
successfully applied to a set of fourteen LV data sets. As 
expected, a large portion of total shape variability is 
captured within the first few eigenvectors. 

Having described embodiments for generating a 3D 
statistical shape model for the left ventricle of the heart, 
it is noted that modifications and variations can be made by 
persons skilled in the art in light of the above teachings. It 
is therefore to be understood that changes may be made in the 
particular embodiments of the invention disclosed which are 
within the scope and spirit of the invention as defined by the 
appended claims. Having thus described the invention with the 
details and particularity required by the patent laws, what is 
claimed and desired protected by Letters Patent is set forth 
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in the appended claims. 
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